2026-09-21 00:22:57,786 [ 185806 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2026-09-21 00:22:57,786 [ 185806 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2026-09-21 00:22:57,786 [ 185806 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2026-09-21 00:22:57,787 [ 185806 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_z4wqe8 --privileged --dns-search='.' --memory=30709030912 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests 'test_distributed_ddl/test.py::test_kill_query[configs_secure]' 'test_distributed_ddl/test.py::test_macro[configs]' 'test_distributed_ddl/test.py::test_macro[configs_secure]' 'test_distributed_ddl/test.py::test_on_server_fail[configs]' 'test_distributed_ddl/test.py::test_on_server_fail[configs_secure]' 'test_distributed_ddl/test.py::test_optimize_query[configs]' 'test_distributed_ddl/test.py::test_optimize_query[configs_secure]' 'test_distributed_ddl/test.py::test_rename[configs]' 'test_distributed_ddl/test.py::test_rename[configs_secure]' 'test_distributed_ddl/test.py::test_replicated_without_arguments[configs]' 'test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure]' 'test_distributed_ddl/test.py::test_simple_alters[configs]' 'test_distributed_ddl/test.py::test_simple_alters[configs_secure]' 'test_distributed_ddl/test.py::test_socket_timeout[configs]' 'test_distributed_ddl/test.py::test_socket_timeout[configs_secure]' 'test_failed_mutations/test.py::test_backoff_clickhouse_restart[False]' 'test_failed_mutations/test.py::test_backoff_clickhouse_restart[True]' test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table test_failed_mutations/test.py::test_exponential_backoff_setting_override 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_snapshots/test.py::test_ephemeral_after_restart test_keeper_snapshots/test.py::test_invalid_snapshot test_keeper_snapshots/test.py::test_snapshot_size test_keeper_snapshots/test.py::test_state_after_restart test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_limit_materialized_view_count/test.py::test_limit_materialized_view_count 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user]' test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete test_merge_tree_empty_parts/test.py::test_empty_parts_summing 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_move_ttl_broken_compatibility/test.py::test_bc_compatibility test_mutations_hardlinks/test.py::test_delete_and_drop_mutation test_mutations_hardlinks/test.py::test_drop_mutation test_mutations_hardlinks/test.py::test_modify_mutation test_mutations_hardlinks/test.py::test_update_mutation test_mysql_protocol/test.py::test_golang_client test_mysql_protocol/test.py::test_java_client_binary test_mysql_protocol/test.py::test_java_client_text test_mysql_protocol/test.py::test_mysql_affected_rows test_mysql_protocol/test.py::test_mysql_boolean_format test_mysql_protocol/test.py::test_mysql_client test_mysql_protocol/test.py::test_mysql_client_exception test_mysql_protocol/test.py::test_mysql_explain test_mysql_protocol/test.py::test_mysql_federated test_mysql_protocol/test.py::test_mysql_replacement_query test_mysql_protocol/test.py::test_mysql_select_user test_mysql_protocol/test.py::test_mysql_set_variables test_mysql_protocol/test.py::test_mysqljs_client test_mysql_protocol/test.py::test_php_client test_mysql_protocol/test.py::test_python_client test_mysql_protocol/test.py::test_types 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0]' -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_distributed_ddl/test.py::test_kill_query[configs_secure] test_mysql_protocol/test.py::test_golang_client test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] test_keeper_snapshots/test.py::test_ephemeral_after_restart test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] test_log_family_s3/test.py::test_log_family_s3[Log] test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] [gw7] [ 1%] PASSED test_keeper_snapshots/test.py::test_ephemeral_after_restart test_keeper_snapshots/test.py::test_invalid_snapshot [gw6] [ 2%] PASSED test_log_family_s3/test.py::test_log_family_s3[Log] test_log_family_s3/test.py::test_log_family_s3[StripeLog] [gw6] [ 3%] PASSED test_log_family_s3/test.py::test_log_family_s3[StripeLog] test_log_family_s3/test.py::test_log_family_s3[TinyLog] [gw0] [ 4%] PASSED test_mysql_protocol/test.py::test_golang_client test_mysql_protocol/test.py::test_java_client_binary [gw9] [ 5%] PASSED test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] [gw6] [ 6%] PASSED test_log_family_s3/test.py::test_log_family_s3[TinyLog] test_log_family_s3/test.py::test_stripe_log_truncate [gw4] [ 7%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] [gw2] [ 8%] PASSED test_distributed_ddl/test.py::test_kill_query[configs_secure] test_distributed_ddl/test.py::test_macro[configs_secure] [gw6] [ 9%] PASSED test_log_family_s3/test.py::test_stripe_log_truncate [gw0] [ 10%] PASSED test_mysql_protocol/test.py::test_java_client_binary test_mysql_protocol/test.py::test_java_client_text [gw2] [ 11%] PASSED test_distributed_ddl/test.py::test_macro[configs_secure] test_distributed_ddl/test.py::test_on_server_fail[configs_secure] [gw3] [ 12%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] [gw4] [ 13%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] [gw9] [ 14%] PASSED test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] [gw0] [ 15%] PASSED test_mysql_protocol/test.py::test_java_client_text test_mysql_protocol/test.py::test_mysql_affected_rows [gw0] [ 16%] PASSED test_mysql_protocol/test.py::test_mysql_affected_rows test_mysql_protocol/test.py::test_mysql_boolean_format [gw1] [ 17%] PASSED test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] [gw0] [ 18%] PASSED test_mysql_protocol/test.py::test_mysql_boolean_format test_mysql_protocol/test.py::test_mysql_client [gw0] [ 19%] PASSED test_mysql_protocol/test.py::test_mysql_client test_mysql_protocol/test.py::test_mysql_client_exception [gw0] [ 20%] PASSED test_mysql_protocol/test.py::test_mysql_client_exception test_mysql_protocol/test.py::test_mysql_explain [gw0] [ 21%] PASSED test_mysql_protocol/test.py::test_mysql_explain test_mysql_protocol/test.py::test_mysql_federated [gw7] [ 22%] PASSED test_keeper_snapshots/test.py::test_invalid_snapshot test_keeper_snapshots/test.py::test_snapshot_size [gw2] [ 23%] PASSED test_distributed_ddl/test.py::test_on_server_fail[configs_secure] test_distributed_ddl/test.py::test_optimize_query[configs_secure] [gw4] [ 24%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] [gw2] [ 25%] PASSED test_distributed_ddl/test.py::test_optimize_query[configs_secure] test_distributed_ddl/test.py::test_rename[configs_secure] test_mutations_hardlinks/test.py::test_delete_and_drop_mutation [gw3] [ 26%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] [gw7] [ 27%] PASSED test_keeper_snapshots/test.py::test_snapshot_size test_keeper_snapshots/test.py::test_state_after_restart [gw9] [ 28%] PASSED test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw4] [ 29%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] [gw7] [ 30%] PASSED test_keeper_snapshots/test.py::test_state_after_restart [gw3] [ 31%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant [gw1] [ 32%] PASSED test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table [gw5] [ 33%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] [gw2] [ 34%] PASSED test_distributed_ddl/test.py::test_rename[configs_secure] test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] [gw4] [ 35%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] [gw9] [ 36%] PASSED test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] [gw1] [ 37%] PASSED test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table test_failed_mutations/test.py::test_exponential_backoff_setting_override [gw1] [ 38%] PASSED test_failed_mutations/test.py::test_exponential_backoff_setting_override test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] [gw3] [ 39%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] [gw7] [ 40%] PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant [gw2] [ 41%] PASSED test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] test_distributed_ddl/test.py::test_simple_alters[configs_secure] test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete [gw1] [ 42%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] [gw3] [ 43%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] [gw1] [ 44%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree [gw1] [ 45%] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] [gw3] [ 46%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] [gw4] [ 47%] FAILED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] [gw2] [ 48%] PASSED test_distributed_ddl/test.py::test_simple_alters[configs_secure] test_distributed_ddl/test.py::test_socket_timeout[configs_secure] [gw5] [ 49%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] [gw1] [ 50%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] [gw9] [ 51%] PASSED test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete test_merge_tree_empty_parts/test.py::test_empty_parts_summing [gw4] [ 52%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] [gw9] [ 53%] PASSED test_merge_tree_empty_parts/test.py::test_empty_parts_summing [gw7] [ 54%] PASSED test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table [gw5] [ 55%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] [gw1] [ 56%] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] [gw3] [ 57%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] test_keeper_profiler/test.py::test_profiler test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 [gw4] [ 58%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] test_library_bridge/test_exiled.py::test_bridge_dies_with_parent [gw5] [ 59%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] [gw3] [ 60%] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] [gw4] [ 61%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] [gw4] [ 62%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] [gw1] [ 63%] SKIPPED test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_limit_materialized_view_count/test.py::test_limit_materialized_view_count test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery [gw7] [ 64%] PASSED test_keeper_profiler/test.py::test_profiler [gw4] [ 65%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] [gw2] [ 66%] PASSED test_distributed_ddl/test.py::test_socket_timeout[configs_secure] test_distributed_ddl/test.py::test_macro[configs] [gw6] [ 67%] PASSED test_mutations_hardlinks/test.py::test_delete_and_drop_mutation test_mutations_hardlinks/test.py::test_drop_mutation [gw6] [ 68%] PASSED test_mutations_hardlinks/test.py::test_drop_mutation test_mutations_hardlinks/test.py::test_modify_mutation [gw9] [ 69%] PASSED test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 [gw4] [ 70%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] [gw6] [ 71%] PASSED test_mutations_hardlinks/test.py::test_modify_mutation test_mutations_hardlinks/test.py::test_update_mutation [gw5] [ 72%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] [gw6] [ 73%] PASSED test_mutations_hardlinks/test.py::test_update_mutation [gw1] [ 74%] PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery [gw3] [ 75%] PASSED test_limit_materialized_view_count/test.py::test_limit_materialized_view_count [gw4] [ 76%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw4] [ 77%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] test_move_ttl_broken_compatibility/test.py::test_bc_compatibility [gw4] [ 78%] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] [gw5] [ 79%] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] [gw2] [ 80%] PASSED test_distributed_ddl/test.py::test_macro[configs] test_distributed_ddl/test.py::test_on_server_fail[configs] [gw7] [ 81%] PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw2] [ 82%] PASSED test_distributed_ddl/test.py::test_on_server_fail[configs] test_distributed_ddl/test.py::test_optimize_query[configs] [gw2] [ 83%] PASSED test_distributed_ddl/test.py::test_optimize_query[configs] test_distributed_ddl/test.py::test_rename[configs] [gw0] [ 84%] PASSED test_mysql_protocol/test.py::test_mysql_federated test_mysql_protocol/test.py::test_mysql_replacement_query [gw0] [ 85%] PASSED test_mysql_protocol/test.py::test_mysql_replacement_query test_mysql_protocol/test.py::test_mysql_select_user [gw0] [ 86%] PASSED test_mysql_protocol/test.py::test_mysql_select_user test_mysql_protocol/test.py::test_mysql_set_variables [gw0] [ 87%] PASSED test_mysql_protocol/test.py::test_mysql_set_variables test_mysql_protocol/test.py::test_mysqljs_client [gw2] [ 88%] PASSED test_distributed_ddl/test.py::test_rename[configs] test_distributed_ddl/test.py::test_replicated_without_arguments[configs] [gw0] [ 89%] PASSED test_mysql_protocol/test.py::test_mysqljs_client test_mysql_protocol/test.py::test_php_client [gw0] [ 90%] PASSED test_mysql_protocol/test.py::test_php_client test_mysql_protocol/test.py::test_python_client [gw0] [ 91%] PASSED test_mysql_protocol/test.py::test_python_client test_mysql_protocol/test.py::test_types [gw0] [ 92%] PASSED test_mysql_protocol/test.py::test_types [gw2] [ 93%] PASSED test_distributed_ddl/test.py::test_replicated_without_arguments[configs] test_distributed_ddl/test.py::test_simple_alters[configs] [gw2] [ 94%] PASSED test_distributed_ddl/test.py::test_simple_alters[configs] test_distributed_ddl/test.py::test_socket_timeout[configs] [gw2] [ 95%] PASSED test_distributed_ddl/test.py::test_socket_timeout[configs] [gw8] [ 96%] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] [gw9] [ 97%] PASSED test_move_ttl_broken_compatibility/test.py::test_bc_compatibility [gw8] [ 98%] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] [gw8] [ 99%] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] [gw8] [100%] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] =================================== FAILURES =================================== _ test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] _ [gw4] linux -- Python 3.10.12 /usr/bin/python3 start_cluster = cluster = 'test_multiple_shards_multiple_replicas', max_parallel_replicas = 3 prefer_localhost_replica = 1 @pytest.mark.parametrize( "cluster,max_parallel_replicas,prefer_localhost_replica", [ pytest.param("test_single_shard_multiple_replicas", 2, 0), pytest.param("test_single_shard_multiple_replicas", 3, 0), pytest.param("test_single_shard_multiple_replicas", 4, 0), pytest.param("test_single_shard_multiple_replicas", 10, 0), pytest.param("test_single_shard_multiple_replicas", 2, 1), pytest.param("test_single_shard_multiple_replicas", 3, 1), pytest.param("test_single_shard_multiple_replicas", 4, 1), pytest.param("test_single_shard_multiple_replicas", 10, 1), pytest.param("test_multiple_shards_multiple_replicas", 2, 0), pytest.param("test_multiple_shards_multiple_replicas", 3, 0), pytest.param("test_multiple_shards_multiple_replicas", 4, 0), pytest.param("test_multiple_shards_multiple_replicas", 10, 0), pytest.param("test_multiple_shards_multiple_replicas", 2, 1), pytest.param("test_multiple_shards_multiple_replicas", 3, 1), pytest.param("test_multiple_shards_multiple_replicas", 4, 1), pytest.param("test_multiple_shards_multiple_replicas", 10, 1), ], ) def test_parallel_replicas_over_distributed( start_cluster, cluster, max_parallel_replicas, prefer_localhost_replica ): table_name = "test_table" > create_tables(cluster, table_name) test_parallel_replicas_over_distributed/test.py:128: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_parallel_replicas_over_distributed/test.py:57: in create_tables nodes[4].query( helpers/cluster.py:3649: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 231, stderr: Received exception from server (version 25.3.14): E Code: 999. DB::Exception: Received from 172.16.1.6:9000. Coordination::Exception. Coordination::Exception: Session expired. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:113: Poco::Exception::Exception(String const&, int) @ 0x000000003867ecd1 E 1. ./build_docker/./src/Common/Exception.cpp:108: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001c089a11 E 2. ./src/Common/Exception.h:112: Coordination::Exception::Exception(T&&, Coordination::Error) @ 0x0000000031663f0d E 3. ./src/Common/ZooKeeper/KeeperException.h:58: Coordination::ZooKeeper::pushRequest(Coordination::ZooKeeper::RequestInfo&&) @ 0x00000000316f35f3 E 4. ./build_docker/./src/Common/ZooKeeper/ZooKeeperImpl.cpp:1652: Coordination::ZooKeeper::multi(std::span const, 18446744073709551615ul>, std::function) @ 0x0000000031700ae7 E 5. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1449: zkutil::ZooKeeper::asyncTryMultiNoThrow(std::span const, 18446744073709551615ul>) @ 0x000000003160adc4 E 6. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:1436: zkutil::ZooKeeper::multiImpl(std::vector, std::allocator>> const&, std::vector, std::allocator>>&, bool) @ 0x00000000315f01b7 E 7. ./build_docker/./src/Common/ZooKeeper/ZooKeeper.cpp:462: zkutil::ZooKeeper::createAncestors(String const&) @ 0x00000000315eefb5 E 8. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:942: DB::StorageReplicatedMergeTree::createTableIfNotExistsAttempt(std::shared_ptr const&, std::shared_ptr) const @ 0x000000002e82145a E 9. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:930: DB::StorageReplicatedMergeTree::createTableIfNotExists(std::shared_ptr const&, DB::ZooKeeperRetriesInfo const&) const @ 0x000000002e8094b4 E 10. ./build_docker/./src/Storages/StorageReplicatedMergeTree.cpp:594: DB::StorageReplicatedMergeTree::StorageReplicatedMergeTree(DB::TableZnodeInfo const&, DB::LoadingStrictnessLevel, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata const&, std::shared_ptr, String const&, DB::MergeTreeData::MergingParams const&, std::unique_ptr>, bool, DB::ZooKeeperRetriesInfo const&) @ 0x000000002e803c46 E 11. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:41: std::shared_ptr std::allocate_shared[abi:ne190107], DB::TableZnodeInfo&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>, bool&, DB::ZooKeeperRetriesInfo&, 0>(std::allocator const&, DB::TableZnodeInfo&, DB::LoadingStrictnessLevel const&, DB::StorageID const&, String const&, DB::StorageInMemoryMetadata&, std::shared_ptr&, String&, DB::MergeTreeData::MergingParams&, std::unique_ptr>&&, bool&, DB::ZooKeeperRetriesInfo&) @ 0x000000002fa15fc1 E 12. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:851: DB::create(DB::StorageFactory::Arguments const&) @ 0x000000002fa0ece2 E 13. ./contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000002e568dd2 E 14. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1945: DB::InterpreterCreateQuery::doCreateTable(DB::ASTCreateQuery&, DB::InterpreterCreateQuery::TableProperties const&, std::unique_ptr>&, DB::LoadingStrictnessLevel) @ 0x000000002a68a588 E 15. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:1743: DB::InterpreterCreateQuery::createTable(DB::ASTCreateQuery&) @ 0x000000002a67bc0d E 16. ./build_docker/./src/Interpreters/InterpreterCreateQuery.cpp:2355: DB::InterpreterCreateQuery::execute() @ 0x000000002a6964d8 E 17. ./build_docker/./src/Interpreters/executeQuery.cpp:1457: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*, std::shared_ptr&) @ 0x000000002af36dc3 E 18. ./build_docker/./src/Interpreters/executeQuery.cpp:1624: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002af2eca5 E 19. ./build_docker/./src/Server/TCPHandler.cpp:664: DB::TCPHandler::runImpl() @ 0x00000000300bf716 E 20. ./build_docker/./src/Server/TCPHandler.cpp:2629: DB::TCPHandler::run() @ 0x00000000300ff3da E 21. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x0000000038859fcf E 22. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000003885ac97 E 23. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x00000000387695eb E 24. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x00000000387631e8 E 25. asan_thread_start(void*) @ 0x000000000c676e77 E 26. ? @ 0x00007f6496fbcac3 E 27. ? @ 0x00007f649704e850 E . (KEEPER_EXCEPTION) E (query: CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard2/test_table', 'r2') ORDER BY (key)) helpers/client.py:248: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2026-09-21 00:24:26.306000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n1 (cluster.py:3648, query) 2026-09-21 00:24:26.674000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n2 (cluster.py:3648, query) 2026-09-21 00:24:27.009000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n3 (cluster.py:3648, query) 2026-09-21 00:24:27.486000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n4 (cluster.py:3648, query) 2026-09-21 00:24:27.857000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n5 (cluster.py:3648, query) 2026-09-21 00:24:28.239000 [ 638 ] DEBUG : Executing query DROP TABLE IF EXISTS test_table SYNC on n6 (cluster.py:3648, query) 2026-09-21 00:24:28.716000 [ 638 ] DEBUG : Executing query CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard1/test_table', 'r1') ORDER BY (key) on n1 (cluster.py:3648, query) 2026-09-21 00:24:29.193000 [ 638 ] DEBUG : Executing query CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard1/test_table', 'r2') ORDER BY (key) on n2 (cluster.py:3648, query) 2026-09-21 00:24:29.615000 [ 638 ] DEBUG : Executing query CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard1/test_table', 'r3') ORDER BY (key) on n3 (cluster.py:3648, query) 2026-09-21 00:24:30.035000 [ 638 ] DEBUG : Executing query CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard2/test_table', 'r1') ORDER BY (key) on n4 (cluster.py:3648, query) 2026-09-21 00:24:30.554000 [ 638 ] DEBUG : Executing query CREATE TABLE IF NOT EXISTS test_table (key Int64, value String) Engine=ReplicatedMergeTree('/test_parallel_replicas/shard2/test_table', 'r2') ORDER BY (key) on n5 (cluster.py:3648, query) ----------------- generated report log file: parallel1_0.jsonl ----------------- ============================== slowest durations =============================== 349.78s call test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] 261.75s call test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] 209.91s call test_mysql_protocol/test.py::test_mysql_federated 188.01s call test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] 186.46s call test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] 149.31s setup test_move_ttl_broken_compatibility/test.py::test_bc_compatibility 108.72s call test_mutations_hardlinks/test.py::test_delete_and_drop_mutation 57.55s call test_distributed_ddl/test.py::test_socket_timeout[configs_secure] 49.15s call test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 45.79s call test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 39.58s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] 38.24s setup test_distributed_ddl/test.py::test_macro[configs] 36.93s call test_distributed_ddl/test.py::test_socket_timeout[configs] 34.02s call test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 34.00s call test_keeper_snapshots/test.py::test_invalid_snapshot 33.95s call test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 33.89s setup test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 32.28s setup test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 32.13s call test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] 29.76s setup test_distributed_ddl/test.py::test_kill_query[configs_secure] 29.35s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 26.63s setup test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete 26.53s call test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] 25.87s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 25.26s teardown test_log_family_s3/test.py::test_stripe_log_truncate 25.20s teardown test_distributed_ddl/test.py::test_socket_timeout[configs] 24.74s call test_distributed_ddl/test.py::test_simple_alters[configs_secure] 24.52s call test_distributed_ddl/test.py::test_rename[configs_secure] 23.54s setup test_mysql_protocol/test.py::test_golang_client 23.16s teardown test_keeper_profiler/test.py::test_profiler 22.58s teardown test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 22.45s call test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] 22.43s teardown test_move_ttl_broken_compatibility/test.py::test_bc_compatibility 22.06s setup test_keeper_profiler/test.py::test_profiler 21.72s setup test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 21.40s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 21.20s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] 20.87s setup test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] 20.83s call test_move_ttl_broken_compatibility/test.py::test_bc_compatibility 20.83s setup test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 20.72s setup test_mutations_hardlinks/test.py::test_delete_and_drop_mutation 20.51s call test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 19.24s call test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 19.02s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 18.80s call test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 18.65s call test_distributed_ddl/test.py::test_simple_alters[configs] 18.63s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 18.62s call test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 18.31s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] 18.30s teardown test_mutations_hardlinks/test.py::test_update_mutation 18.26s teardown test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 17.43s call test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 17.30s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 17.18s setup test_log_family_s3/test.py::test_log_family_s3[Log] 17.06s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 17.01s call test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 17.00s call test_distributed_ddl/test.py::test_on_server_fail[configs_secure] 16.91s call test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 16.54s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 16.09s call test_distributed_ddl/test.py::test_rename[configs] 15.99s setup test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 15.89s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] 15.47s setup test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 15.32s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 15.26s setup test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] 15.17s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 14.93s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] 14.29s call test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 14.14s setup test_limit_materialized_view_count/test.py::test_limit_materialized_view_count 13.95s setup test_keeper_snapshots/test.py::test_ephemeral_after_restart 13.63s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 13.62s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] 13.35s setup test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 12.95s teardown test_merge_tree_empty_parts/test.py::test_empty_parts_summing 12.37s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] 11.96s call test_distributed_ddl/test.py::test_macro[configs] 11.88s call test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 11.67s call test_keeper_snapshots/test.py::test_state_after_restart 11.60s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 11.42s call test_mysql_protocol/test.py::test_java_client_binary 10.99s call test_distributed_ddl/test.py::test_replicated_without_arguments[configs] 10.63s teardown test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 10.60s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] 10.21s call test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 9.84s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] 9.65s call test_distributed_ddl/test.py::test_on_server_fail[configs] 9.61s call test_mysql_protocol/test.py::test_java_client_text 9.32s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] 9.16s call test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 8.88s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] 8.86s call test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 8.78s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] 8.77s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 8.35s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] 8.22s teardown test_mysql_protocol/test.py::test_types 7.69s teardown test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] 7.29s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] 7.06s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] 7.02s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] 6.88s call test_limit_materialized_view_count/test.py::test_limit_materialized_view_count 6.84s call test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] 6.78s call test_keeper_snapshots/test.py::test_snapshot_size 6.74s call test_distributed_ddl/test.py::test_macro[configs_secure] 6.53s call test_failed_mutations/test.py::test_exponential_backoff_setting_override 6.07s call test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 5.58s call test_keeper_snapshots/test.py::test_ephemeral_after_restart 5.18s call test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table 4.99s call test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete 4.80s call test_merge_tree_empty_parts/test.py::test_empty_parts_summing 4.71s teardown test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 4.51s call test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant 4.26s call test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table 4.18s call test_log_family_s3/test.py::test_stripe_log_truncate 3.82s call test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 3.28s call test_log_family_s3/test.py::test_log_family_s3[TinyLog] 3.14s call test_log_family_s3/test.py::test_log_family_s3[Log] 3.05s call test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 2.92s teardown test_keeper_snapshots/test.py::test_state_after_restart 2.90s call test_mutations_hardlinks/test.py::test_update_mutation 2.80s call test_log_family_s3/test.py::test_log_family_s3[StripeLog] 2.50s teardown test_limit_materialized_view_count/test.py::test_limit_materialized_view_count 2.29s call test_mysql_protocol/test.py::test_mysql_client 2.06s call test_mutations_hardlinks/test.py::test_modify_mutation 1.70s call test_distributed_ddl/test.py::test_optimize_query[configs_secure] 1.65s teardown test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 1.53s teardown test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 1.49s call test_mutations_hardlinks/test.py::test_drop_mutation 1.29s call test_mysql_protocol/test.py::test_mysql_affected_rows 1.17s call test_mysql_protocol/test.py::test_mysql_boolean_format 1.10s call test_distributed_ddl/test.py::test_optimize_query[configs] 0.96s call test_mysql_protocol/test.py::test_mysqljs_client 0.84s call test_library_bridge/test_exiled.py::test_bridge_dies_with_parent 0.75s call test_mysql_protocol/test.py::test_mysql_replacement_query 0.68s call test_mysql_protocol/test.py::test_mysql_explain 0.60s setup test_mysql_protocol/test.py::test_java_client_binary 0.56s call test_keeper_profiler/test.py::test_profiler 0.53s setup test_mysql_protocol/test.py::test_mysqljs_client 0.50s setup test_mysql_protocol/test.py::test_php_client 0.44s call test_mysql_protocol/test.py::test_php_client 0.42s call test_distributed_ddl/test.py::test_kill_query[configs_secure] 0.28s call test_mysql_protocol/test.py::test_golang_client 0.24s call test_mysql_protocol/test.py::test_mysql_client_exception 0.15s call test_mysql_protocol/test.py::test_python_client 0.10s call test_mysql_protocol/test.py::test_mysql_select_user 0.09s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] 0.09s call test_mysql_protocol/test.py::test_mysql_set_variables 0.02s setup test_mysql_protocol/test.py::test_mysql_client_exception 0.02s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] 0.02s call test_mysql_protocol/test.py::test_types 0.02s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 0.01s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] 0.01s setup test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] 0.01s teardown test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] 0.01s teardown test_distributed_ddl/test.py::test_socket_timeout[configs_secure] 0.01s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] 0.01s teardown test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] 0.01s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.01s teardown test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete 0.00s setup test_distributed_ddl/test.py::test_optimize_query[configs_secure] 0.00s teardown test_mutations_hardlinks/test.py::test_delete_and_drop_mutation 0.00s teardown test_keeper_snapshots/test.py::test_invalid_snapshot 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 0.00s teardown test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] 0.00s teardown test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] 0.00s teardown test_distributed_ddl/test.py::test_kill_query[configs_secure] 0.00s teardown test_mysql_protocol/test.py::test_mysql_federated 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s setup test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] 0.00s setup test_mysql_protocol/test.py::test_mysql_affected_rows 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] 0.00s setup test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] 0.00s setup test_distributed_ddl/test.py::test_macro[configs_secure] 0.00s setup test_keeper_snapshots/test.py::test_snapshot_size 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 0.00s setup test_mutations_hardlinks/test.py::test_drop_mutation 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] 0.00s setup test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] 0.00s teardown test_distributed_ddl/test.py::test_on_server_fail[configs_secure] 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 0.00s setup test_distributed_ddl/test.py::test_socket_timeout[configs_secure] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 0.00s teardown test_mysql_protocol/test.py::test_java_client_binary 0.00s teardown test_distributed_ddl/test.py::test_macro[configs] 0.00s setup test_distributed_ddl/test.py::test_simple_alters[configs_secure] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] 0.00s teardown test_distributed_ddl/test.py::test_optimize_query[configs_secure] 0.00s setup test_mysql_protocol/test.py::test_java_client_text 0.00s teardown test_distributed_ddl/test.py::test_rename[configs_secure] 0.00s teardown test_distributed_ddl/test.py::test_simple_alters[configs_secure] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] 0.00s teardown test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] 0.00s setup test_mysql_protocol/test.py::test_mysql_replacement_query 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] 0.00s teardown test_keeper_snapshots/test.py::test_snapshot_size 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 0.00s setup test_keeper_snapshots/test.py::test_state_after_restart 0.00s setup test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] 0.00s setup test_merge_tree_empty_parts/test.py::test_empty_parts_summing 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] 0.00s teardown test_keeper_snapshots/test.py::test_ephemeral_after_restart 0.00s setup test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_setting_override 0.00s setup test_distributed_ddl/test.py::test_on_server_fail[configs] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] 0.00s setup test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] 0.00s setup test_distributed_ddl/test.py::test_socket_timeout[configs] 0.00s setup test_distributed_ddl/test.py::test_on_server_fail[configs_secure] 0.00s setup test_distributed_ddl/test.py::test_rename[configs] 0.00s setup test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] 0.00s setup test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] 0.00s setup test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] 0.00s setup test_distributed_ddl/test.py::test_rename[configs_secure] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] 0.00s setup test_log_family_s3/test.py::test_stripe_log_truncate 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] 0.00s setup test_mutations_hardlinks/test.py::test_update_mutation 0.00s setup test_mysql_protocol/test.py::test_mysql_explain 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] 0.00s setup test_distributed_ddl/test.py::test_optimize_query[configs] 0.00s teardown test_mysql_protocol/test.py::test_golang_client 0.00s teardown test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] 0.00s setup test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] 0.00s setup test_mysql_protocol/test.py::test_mysql_boolean_format 0.00s teardown test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] 0.00s setup test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] 0.00s setup test_distributed_ddl/test.py::test_replicated_without_arguments[configs] 0.00s setup test_distributed_ddl/test.py::test_simple_alters[configs] 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[Log] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] 0.00s setup test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[StripeLog] 0.00s teardown test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] 0.00s setup test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] 0.00s teardown test_mysql_protocol/test.py::test_mysqljs_client 0.00s teardown test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] 0.00s setup test_mysql_protocol/test.py::test_python_client 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] 0.00s teardown test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] 0.00s teardown test_distributed_ddl/test.py::test_optimize_query[configs] 0.00s teardown test_log_family_s3/test.py::test_log_family_s3[TinyLog] 0.00s teardown test_distributed_ddl/test.py::test_replicated_without_arguments[configs] 0.00s teardown test_mysql_protocol/test.py::test_mysql_client 0.00s setup test_failed_mutations/test.py::test_exponential_backoff_setting_override 0.00s setup test_mysql_protocol/test.py::test_types 0.00s teardown test_distributed_ddl/test.py::test_simple_alters[configs] 0.00s teardown test_mysql_protocol/test.py::test_mysql_set_variables 0.00s setup test_keeper_snapshots/test.py::test_invalid_snapshot 0.00s teardown test_mutations_hardlinks/test.py::test_drop_mutation 0.00s setup test_mysql_protocol/test.py::test_mysql_federated 0.00s teardown test_mysql_protocol/test.py::test_java_client_text 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 0.00s setup test_mysql_protocol/test.py::test_mysql_set_variables 0.00s setup test_mysql_protocol/test.py::test_mysql_select_user 0.00s setup test_mutations_hardlinks/test.py::test_modify_mutation 0.00s teardown test_distributed_ddl/test.py::test_rename[configs] 0.00s teardown test_mysql_protocol/test.py::test_mysql_replacement_query 0.00s teardown test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table 0.00s teardown test_mutations_hardlinks/test.py::test_modify_mutation 0.00s teardown test_mysql_protocol/test.py::test_mysql_affected_rows 0.00s setup test_mysql_protocol/test.py::test_mysql_client 0.00s teardown test_mysql_protocol/test.py::test_mysql_client_exception 0.00s teardown test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] 0.00s teardown test_mysql_protocol/test.py::test_php_client 0.00s teardown test_distributed_ddl/test.py::test_macro[configs_secure] 0.00s teardown test_mysql_protocol/test.py::test_mysql_select_user 0.00s teardown test_mysql_protocol/test.py::test_mysql_explain 0.00s teardown test_mysql_protocol/test.py::test_python_client 0.00s teardown test_distributed_ddl/test.py::test_on_server_fail[configs] 0.00s teardown test_mysql_protocol/test.py::test_mysql_boolean_format =========================== short test summary info ============================ FAILED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1] PASSED test_keeper_snapshots/test.py::test_ephemeral_after_restart PASSED test_log_family_s3/test.py::test_log_family_s3[Log] PASSED test_log_family_s3/test.py::test_log_family_s3[StripeLog] PASSED test_mysql_protocol/test.py::test_golang_client PASSED test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2] PASSED test_log_family_s3/test.py::test_log_family_s3[TinyLog] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0] PASSED test_distributed_ddl/test.py::test_kill_query[configs_secure] PASSED test_log_family_s3/test.py::test_stripe_log_truncate PASSED test_mysql_protocol/test.py::test_java_client_binary PASSED test_distributed_ddl/test.py::test_macro[configs_secure] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1] PASSED test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1] PASSED test_mysql_protocol/test.py::test_java_client_text PASSED test_mysql_protocol/test.py::test_mysql_affected_rows PASSED test_failed_mutations/test.py::test_backoff_clickhouse_restart[False] PASSED test_mysql_protocol/test.py::test_mysql_boolean_format PASSED test_mysql_protocol/test.py::test_mysql_client PASSED test_mysql_protocol/test.py::test_mysql_client_exception PASSED test_mysql_protocol/test.py::test_mysql_explain PASSED test_keeper_snapshots/test.py::test_invalid_snapshot PASSED test_distributed_ddl/test.py::test_on_server_fail[configs_secure] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0] PASSED test_distributed_ddl/test.py::test_optimize_query[configs_secure] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1] PASSED test_keeper_snapshots/test.py::test_snapshot_size PASSED test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1] PASSED test_keeper_snapshots/test.py::test_state_after_restart PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0] PASSED test_failed_mutations/test.py::test_backoff_clickhouse_restart[True] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0] PASSED test_distributed_ddl/test.py::test_rename[configs_secure] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0] PASSED test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1] PASSED test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table PASSED test_failed_mutations/test.py::test_exponential_backoff_setting_override PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1] PASSED test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant PASSED test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False] PASSED test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1] PASSED test_distributed_ddl/test.py::test_simple_alters[configs_secure] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False] PASSED test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0] PASSED test_merge_tree_empty_parts/test.py::test_empty_parts_summing PASSED test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0] PASSED test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1] PASSED test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1] PASSED test_keeper_profiler/test.py::test_profiler PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0] PASSED test_distributed_ddl/test.py::test_socket_timeout[configs_secure] PASSED test_mutations_hardlinks/test.py::test_delete_and_drop_mutation PASSED test_mutations_hardlinks/test.py::test_drop_mutation PASSED test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1] PASSED test_mutations_hardlinks/test.py::test_modify_mutation PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0] PASSED test_mutations_hardlinks/test.py::test_update_mutation PASSED test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery PASSED test_limit_materialized_view_count/test.py::test_limit_materialized_view_count PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1] PASSED test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0] PASSED test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1] PASSED test_distributed_ddl/test.py::test_macro[configs] PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader PASSED test_distributed_ddl/test.py::test_on_server_fail[configs] PASSED test_distributed_ddl/test.py::test_optimize_query[configs] PASSED test_mysql_protocol/test.py::test_mysql_federated PASSED test_mysql_protocol/test.py::test_mysql_replacement_query PASSED test_mysql_protocol/test.py::test_mysql_select_user PASSED test_mysql_protocol/test.py::test_mysql_set_variables PASSED test_distributed_ddl/test.py::test_rename[configs] PASSED test_mysql_protocol/test.py::test_mysqljs_client PASSED test_mysql_protocol/test.py::test_php_client PASSED test_mysql_protocol/test.py::test_python_client PASSED test_mysql_protocol/test.py::test_types PASSED test_distributed_ddl/test.py::test_replicated_without_arguments[configs] PASSED test_distributed_ddl/test.py::test_simple_alters[configs] PASSED test_distributed_ddl/test.py::test_socket_timeout[configs] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server] PASSED test_move_ttl_broken_compatibility/test.py::test_bc_compatibility PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server] PASSED test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user] SKIPPED [1] test_library_bridge/test_exiled.py:54: Leak sanitizer falsely reports about a leak of 16 bytes in clickhouse-odbc-bridge ============= 1 failed, 98 passed, 1 skipped in 1012.01s (0:16:52) ============= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_z4wqe8 --privileged --dns-search='.' --memory=30709030912 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests 'test_distributed_ddl/test.py::test_kill_query[configs_secure]' 'test_distributed_ddl/test.py::test_macro[configs]' 'test_distributed_ddl/test.py::test_macro[configs_secure]' 'test_distributed_ddl/test.py::test_on_server_fail[configs]' 'test_distributed_ddl/test.py::test_on_server_fail[configs_secure]' 'test_distributed_ddl/test.py::test_optimize_query[configs]' 'test_distributed_ddl/test.py::test_optimize_query[configs_secure]' 'test_distributed_ddl/test.py::test_rename[configs]' 'test_distributed_ddl/test.py::test_rename[configs_secure]' 'test_distributed_ddl/test.py::test_replicated_without_arguments[configs]' 'test_distributed_ddl/test.py::test_replicated_without_arguments[configs_secure]' 'test_distributed_ddl/test.py::test_simple_alters[configs]' 'test_distributed_ddl/test.py::test_simple_alters[configs_secure]' 'test_distributed_ddl/test.py::test_socket_timeout[configs]' 'test_distributed_ddl/test.py::test_socket_timeout[configs_secure]' 'test_failed_mutations/test.py::test_backoff_clickhouse_restart[False]' 'test_failed_mutations/test.py::test_backoff_clickhouse_restart[True]' test_failed_mutations/test.py::test_exponential_backoff_create_dependent_table test_failed_mutations/test.py::test_exponential_backoff_setting_override 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node0-True]' 'test_failed_mutations/test.py::test_exponential_backoff_with_merge_tree[node1-False]' test_failed_mutations/test.py::test_exponential_backoff_with_replicated_tree 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[False]' 'test_failed_mutations/test.py::test_no_backoff_after_killing_mutation[True]' test_grant_and_revoke/test_without_table_engine_grant.py::test_table_engine_and_source_grant test_groupBitmapAnd_on_distributed/test_groupBitmapAndState_on_distributed_table.py::test_groupBitmapAndState_on_distributed_table test_keeper_profiler/test.py::test_profiler test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_restore_from_snapshot/test_disk_s3.py::test_recover_from_snapshot_with_disk_s3 test_keeper_snapshots/test.py::test_ephemeral_after_restart test_keeper_snapshots/test.py::test_invalid_snapshot test_keeper_snapshots/test.py::test_snapshot_size test_keeper_snapshots/test.py::test_state_after_restart test_library_bridge/test_exiled.py::test_bridge_dies_with_parent test_limit_materialized_view_count/test.py::test_limit_materialized_view_count 'test_log_family_s3/test.py::test_log_family_s3[Log]' 'test_log_family_s3/test.py::test_log_family_s3[StripeLog]' 'test_log_family_s3/test.py::test_log_family_s3[TinyLog]' test_log_family_s3/test.py::test_stripe_log_truncate test_materialized_view_restart_server/test.py::test_materialized_view_with_subquery 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[server]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_group_by[user]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[server]' 'test_max_bytes_ratio_before_external_order_group_by_for_server/test.py::test_max_bytes_ratio_before_external_sort[user]' test_merge_tree_empty_parts/test.py::test_empty_parts_alter_delete test_merge_tree_empty_parts/test.py::test_empty_parts_summing 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[0-4-2]' 'test_merge_tree_s3_with_cache/test.py::test_read_after_cache_is_wiped[8192-2-1]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[0-2]' 'test_merge_tree_s3_with_cache/test.py::test_write_is_cached[8192-1]' test_move_ttl_broken_compatibility/test.py::test_bc_compatibility test_mutations_hardlinks/test.py::test_delete_and_drop_mutation test_mutations_hardlinks/test.py::test_drop_mutation test_mutations_hardlinks/test.py::test_modify_mutation test_mutations_hardlinks/test.py::test_update_mutation test_mysql_protocol/test.py::test_golang_client test_mysql_protocol/test.py::test_java_client_binary test_mysql_protocol/test.py::test_java_client_text test_mysql_protocol/test.py::test_mysql_affected_rows test_mysql_protocol/test.py::test_mysql_boolean_format test_mysql_protocol/test.py::test_mysql_client test_mysql_protocol/test.py::test_mysql_client_exception test_mysql_protocol/test.py::test_mysql_explain test_mysql_protocol/test.py::test_mysql_federated test_mysql_protocol/test.py::test_mysql_replacement_query test_mysql_protocol/test.py::test_mysql_select_user test_mysql_protocol/test.py::test_mysql_set_variables test_mysql_protocol/test.py::test_mysqljs_client test_mysql_protocol/test.py::test_php_client test_mysql_protocol/test.py::test_python_client test_mysql_protocol/test.py::test_types 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_load_balancing/test.py::test_parallel_replicas_custom_key_load_balancing[custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_error_on_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_no_unavailable_shards[1]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[0]' 'test_parallel_replicas_distributed_skip_shards/test.py::test_skip_unavailable_shards[1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-10-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-2-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-3-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_multiple_shards_multiple_replicas-4-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-10-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-2-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-0]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-3-1]' 'test_parallel_replicas_over_distributed/test.py::test_parallel_replicas_over_distributed[test_single_shard_multiple_replicas-4-0]' -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 ' returned non-zero exit status 1.